Papers with generative Large Language Models
Forged-GAN-BERT: Authorship Attribution for LLM-Generated Forged Novels (2024.eacl-srw)
Copied to clipboard
| Challenge: | generative Large Language Models (LLMs) are capable of producing human-like texts, but they pose challenges related to the authenticity of the text documents. |
| Approach: | They propose a modified GANBERT-based model to improve the classification of forged novels via the Forged Novels Generator and the generator in GAN. |
| Outcome: | The proposed model improves classification of forged novels in two data-augmentation aspects. |
Natural Context Drift Undermines the Natural Language Understanding of Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | generative Large Language Models (LLMs) are based on natural text evolution . |
| Approach: | They propose a framework for curating naturally evolved variants of reading passages from contemporary QA benchmarks and for analysing LLM performance across a range of semantic similarity scores. |
| Outcome: | The proposed framework evaluates QA datasets and LLMs with publicly available training data. |
Teaching Probabilistic Logical Reasoning to Transformers (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing approaches to reasoning using transformers are limiting, resulting in inconsistent results in arithmetic and QA benchmarks. |
| Approach: | They propose a novel approach that utilizes probabilistic logical rules as constraints in the fine-tuning phase without relying on them in the inference stage. |
| Outcome: | The proposed approach improves the transformer-based language model’s intrinsic reasoning and makes their probabilistic logical reasoning process more explicit and explainable. |
A Scalable Framework for Automated NER Annotation Correction in Low-Resource Languages (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing NER benchmarks lack quality annotations, resulting in poor performance. |
| Approach: | They propose a frequency-based iterative approach that leverages self-training and a dual-threshold mechanism to enhance inference confidence. |
| Outcome: | The proposed approach improves NER performance on three datasets with a high number of missing annotations. |
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)
Copied to clipboard
Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang
| Challenge: | Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability. |
| Approach: | They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality. |
| Outcome: | The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks. |
The Invalsi Benchmarks: measuring the Linguistic and Mathematical understanding of Large Language Models in Italian (2025.coling-main)
Copied to clipboard
| Challenge: | Invalsi MATE is a high-resource language, but there are few benchmarks to evaluate generative Large Language Models in this language. |
| Approach: | They propose three benchmarks to evaluate language models on mathematical understanding in italian . they use the Invalsi tests, which are administered to students aged 6 to 18 in the italian school system . |
| Outcome: | The proposed benchmarks are based on the Invalsi tests and the Italian highschool math Olympics. |
Knowledge-Infused Legal Wisdom: Navigating LLM Consultation through the Lens of Diagnostics and Positive-Unlabeled Reinforcement Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent years have witnessed a substantial increase in the demand for legal services, especially for individuals with modest means. |
| Approach: | They propose a diagnostic legal large language model which uses adaptive lawyer-like diagnostic questions to collect additional case information and then provides high-quality feedback. |
| Outcome: | The proposed model surpasses classical LLMs by providing outstanding performance and a remarkable user experience in the legal domain. |
Penetrating Linguistic Disguises: A Slang-aware Label-Aligned Framework for Fine-Grained Toxicity Extraction in Chinese Hate Speech Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Flexible word boundaries and linguistic obfuscation, particularly slang, challenge precise span-level hate speech detection in Chinese. |
| Approach: | They propose a Slang-aware Label-Aligned Framework that maps slang to explicit hate semantics and uses task-specific branches to mitigate feature interference. |
| Outcome: | The proposed framework reduces ambiguity by mapping obscure slang to explicit hate semantics. |